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Introduction 


Much  of  the  recent  research  efforts  in  Information  Theory  have 
been  devoted  to  the  study  of  multi-user  channels.  Interest  in 
this  area  derived  from  an  early  paper  of  Shannon  [1] . Most  of  the  work 
done  since  then  can  be  found  in  a recent  survey  paper  by  Van  der  Meulen 
[2] . The  vast  majority  of  results  are  in  the  form  of  coding  and  capacity 
theorems,  the  former  being  proved  by  the  use  of  random  coding  arguments. 

Two  multi-user  channels  which  have  received  considerable  attention 
are  the  broadcast  channel  [3]  and  the  multiple-access  channel  [4,5,6].  The 
broadcast  channel  models  the  problem  in  which  one  transmitter  is  interested 
in  communicating  with  several  receivers.  The  dual  problem  in  which 
several  transmitters  wish  to  communicate  with  one  receiver  is  modelled 
by  the  multiple-access  channel. 

In  this  paper,  we  will  develop  deterministic  feedback  coding 
schemes  for  the  additive  white  Gaussian  noise  ( AWGN ) broadcast  channel 
and  multiple-access  channel.  For  a model  of  the  AWGN  broadcast  channel 
with  feedback,  the  proposed  scheme  achieves  all  points  in  the  capacity 
region.  A proposed  scheme  for  the  AWGN  multiple-access  channel  with 
feedback  is  shown  to  achieve  rate  points  beyond  those  found  by  Cover 
and  Leung  [7] . 

The  broadcast  channel  is  considered  in  Section  2.  Section  3 analyzes 
the  multiple-access  channel.  A discussion  of  the  results  is  given  in 


the  last  section. 
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2.  The  AWGN  Broadcast  Channel 

In  his  innovative  paper  on  broadcast  channe_s  [3 ] , Cover  analyzed  the 
additive  white  Gaussian  noise  (AWGN)  broadcast  channel  in  which  one  trans- 
mitter with  an  average  power  constraint  P wishes  to  communicate  with  two  or 
more  receivers.  For  simplicity,  we  confine  the  discussion  to  the  two-receiver 
case.  Suppose  that  the  channel  bandwidth  is  W and  the  noises  to  the  first 
and  second  receivers  have  (two-sided)  power  spectral  densities  N^/2  and  (N^+N^/^ 
respectively.  Under  this  condition,  Cover  [3.]  and  Bergmans  [3]  showed,  by  random 
coding  arguments,  that  all  rate  pairs  (R^,R2)  such  that 

R2  < W In  (1  + ^ ) = C1(0) 

R-  1 w £n  (1  + — ) = C (a) , ae[0,l] , a = 1 - a (1) 

aP+Wj+N  )W  1 

are  achievable,  i.e.  reliable  communication  from  the  transmitter  to  receivers 
1 and  2 is  simultaneously  possible  at  rates  R,  and  R„  respectively.  The  rate 
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region  defined  by  (1)  was  later  shown  to  be  the  capacity  region  by  Bergmans  [9]. 

In  this  paper  we  consider  a model  of  the  AWGN  broadcast  channel  with  feed- 
back depicted  in  Figure  1 and  propose  a deterministic  coding  scheme  which  achieves 
the  region  defined  by  (1) . 

In  section  2.1  we  first  consider  a model  of  the  AWGN  broadcast  channel 
with  feedback  depicted  in  Figure  1 and  propose  a deterministic  coding  scheme 
which  achieves  the  region  defined  by  (1).  Section  2.2  examines  a model  in  which 
the  noises  on  the  forward  channels  are  independent.  The  schemes  employed  are 
reminiscent  of  a procedure  used  by  Schalkwijk  and  Kailath  (10,  11]  on  additive 
noise  channels  with  a single  receiver.  For  both  models,  the  feedback  schemes 
achieve  all  points  within  the  corresponding  capacity  regions. 


Figure  1.  AWGN  Broadcast  Channel  with  Feedback 


As  shown  in  Figure  1,  receiver  2's  signal  is  a noisy  version  of  receiver 
l's  signal.  The  first  decoder  can  feed  data  back  noiselessly  to  the  encoder. 

The  data  fed  back  by  the  second  decoder  can  be  viewed  by  both  the  encoder  and 
the  first  decoder.  This  model  would  be  applicable,  for  example,  in  a situation 
where  the  first  receiver  is  physically  located  between  the  transmitter  and  the 
second  receiver. 

The  feedback  data  may  be  any  function  of  the  received  data  which  allows 
the  transmitter  to  reconstruct  each  receiver's  current  estimate.  Two  obvious 
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possibilities  are  for  the  receivers  to  send  back  their  current  estimates  of 
their  received  signal.  Here,  we  will  assume  that  the  received  signals  are 
actually  fed  back. 


For  convenience,  we  summarize  here  the  notation  to  be  used  in  subsequent 
sections.  The  terms  will  be  explained  more  fully  as  they  appear  in  the  text. 
0^,  i=l,2  is  the  point  corresponding  to  the  message  to  be  transmitted  by 


source  i. 

Zi>n,  i=l,2,  n=-l,0,l,2,3,...  are  independent  Gaussian  noise  random  vari- 

ables  with  means  0 and  variances  CT^  **  N^/2. 

Xn  is  the  transmitter  output  at  time  n.  and  Y2  n are  the  corresponding 

outputs  at  the  two  receivers.  The  feedback  data  at  time  n are  denoted  by  W,  anc 

i,n 

W2,n‘0f  course  Xn+1  is  a function  of  (®1'02'W1,1'W1,2 Wl,n'W2,l'W2,2 W2,n] 

6 A 

0,  and  0O  are  the  estimates  by  decoders  1 and  2 respectively  of 
1 f n ^ t n 

A 

0^  and  02  at  time  n.  Of  course,  in  our  model  ®2,n  *-s  also  available  to  the  first 
decoder. 


2.1.1  The  Coding  Scheme 


In  this  sub-section,  we  will  examine  a coding  scheme  which  can  achieve 
reliable  communication  from  source  i to  receiver  i at  rates  defined  by  (1).  We 
first  look  at  the  initialization  procedure  and  then  use  an  induction  argument 
to  analyze  the  proposed  scheme.  Discussion  of  the  scheme  is  postponed  to  a later 
section . 

Suppose  that  source  i wishes  to  send  one  of  NL  messages  to  receiver  i. 
Corresponding  to  source  i,  we  divide  the  unit  interval  [0,1]  into  disjoint 
message  intervals  of  equal  length.  Let  0^  be  the  mid-point  of  the  message 
interval  corresponding  to  the  message  to  be  transmitted  to  receiver  i. 


A.  Initialization 


During  the  initialization  period,  the  encoder  transmits  two  numbers 
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X_x  = (0.5-G1)  and  XQ  = (0.5-©2). 


Receiver  1 gets  Y 


1,-1  “ (0*5-Ql)  + *1,-1 


(2) 


1,0 


(O*5-02)  + Zl,0 


Receiver  2 gets  Y * (0.5-0.)  + Z.  , + Z, 


(3) 

(4) 


2,0 


{O‘5-02)  + *1.0  + Z2 ,0* 


(5) 


The  first  receiver  subtracts  (2)  from  o.5  to  obtain 


§ 


1,0 


0 - z 

1 1,-1 


(6) 


and  also  computes  (from  receiver  2's  feedback) 


0,  n - 0,  - (Z.  + Z.  .) 

* / v « if  0 2,0 


(7) 


The  second  receiver  subtracts  (5)  from  0.5  to  obtain 


02,O  = 02  ’ (Z1,0  + Z2,0K 


(8) 


Mote  that  the  second  decoder  does  r.ot  attempt  to  estimate  G^.  If  we 
define  to  be  receiver  l's  error  after  the  ktn  transmission,  and 
to  be  receiver  2's  error,  then 


n = - z 

0 1,-1 


- (Z1,0  * z2,0> 


(9) 

(10) 


and 


E(n02]  - c? 

2 2 

e rr  i + a 

L ^0  J 1 2 


EW  * 0 


(11) 

(12) 

(13) 


We  now  proceed  to  the  iterative  step. 
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B.  Procedure  at  time  k+1 

We  assume  that  after  time  k,  the  first  receiver  has 


0, 


l,k  1 

and  both  receivers  have 


Q—  " 02  + 


Ck02  - dk  + \ 


2,k 


(14) 


(15) 


where  2 


2k 


(16) 


r2  = !>L_'  a*  + ch,2 


2k 


(17) 


\*k  = 


= 0 


(18) 


2 ' 2 r \ *■» 

C and  d are  constants,  a « l+g  , cd‘  = ’.+g"  and  g and  g arc  positive  constant 

KK  1 1 « • 1 2 

to  ’leim^termined  lun.er . At  tjj#ie  k+1,  the  encoder  transmits 

Vx  ’ Yi\  + aV  (19) 

The  encoder  determines  tv  and  £ recursively  from  h and  £ through 
equations  ( 2 7)  and  ( 34) . 

Receiver  1 gets 
Y 


1'lt+l  * Vl  * Zl,k+1  ■ Hai\  * *2*2 X * h, 


k+1 


(20) 


It  also  has  its  previous  estimate 


9l,k  = 01  + Ck02  ' dk  + V 


(21) 
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Subtracting  L—  Y1>lc+1  from  (21)  yields 


0i * -S  ' 


l,k+l 

k 


Using  (15)  in  (22)  yields 


h * (ck  + 


5,0. 


g2°S  A 
L 2 © ) 

k 2,k 


k 1/k+l 


Finally  we  form 


(21)  + <31  (23) 

1 + gi2 


q g a k g,g0a0k/v 

ei+  (ck  + -H£-)Q2-  (dk  + Tk ~ V 

“i  °s. 


+ a 2 nk  " k+2  l,k+l 


Comparing  (24)  with  (14)  yields 

k 

t gi92*> 

Ck+1  Ck  k+2 


gig2a2  a 

\+l  dk  + „ k+2  2,k 

1 


\ 

\+l  “ ^2  “ ^k+2  Zl,k+1 


We  note  that 


"v  22 

“T  + ai 

ai  ai 


In  (29)  we  have  made  use  of  (16). 


At  time  k+1,  receiver  2 gets 


+ + z-,  (30) 


2, k+1 


Vl  " 2l.k+l  + Z2.k*l  ' Vl  + Va  ^ 1,k+1  2'ktl 


It  also  has  the  old  estimate 


02,k  " °2  + V 

1 A 

Subtracting  — Y^  from  02,k  ^elds 


k (Zl,k+l  + Z2,k+1)’ 


We  then  form 


. <31>  + *22  1321  „ , 5k  Val, 

°2,k+l  " " 2 02  + 2 " k+2  \ 

*•  ' 1 J.  n CL 


i + g- 


k+2  (Zl,k+l  + z2,k+l) 


a2  a2 


Conparing  (33)  with  (15)  we  obtain 


5.  gn9,a-,  9-> 

m 1c  ^ / rj  +7  ) 

’k+1  2 k+2  nk  k+2  l,k+l  2, k+1 

a2  a2  a2 


Making  use  of  (16),  (17)  and  (18)  it  can  be  easily  shown  that 


bk  + gig2°l  + g2(°l  + °2) 
2 (k+2) 


Comparison  of  (35)  with  (17)  yields 
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(36) 


(37) 


(38) 


After  the  initial  step,  equations  (14)  throuoh  (18)  hold  with 

2 2 2 

= 0,  and  bQ  = + a2  (_<  b ) . Thus  by  induction  equations  (14) 

through  (18)  hold  for  k=l,2,3, 


2.1.2  Achievable  Rates  for  Reliable  Transmission 


Recapitulating  the  main  results  of  the  previous  section,  we  observe 

"i  4-  i m a M 


(33) 
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31,N  = ®1  + CN02  ' \ + % 


02,N  02  + 


(40) 


where  n and  ^ are  Gaussian  random  variables  with  means  0 and  variances 

a2  b2 

— — and  -4!—  respectively.  c and  d can  be  computed  recursively  by  (25)  and 
2N  2N  N n 


(26)  and  the  fact  that  CQ=dQ=0 . To  compute  the  error  probability  at  the  second 

A 

receiver,  we  note  that  this  is  equal  to  the  probability  that  N ~:es  outside 


the  correct  message  interval  of  length  — . 

/ o?  \ 

Thus  P =22  — I where  Q(a)  = 

e,2  \-M2bN  / 

we  can  upperbound  P by 

S f z 


1 2 

e dx.  Since  b„,  < b, 

a /2ir  N" 


a. 


p < 2 Q 

e,  2 — * 


= 2 Q 


2M2b 


2M2  ^ aiCTl  + °2 


(41) 


(42) 


If  we  let  M_  = , £ > 0,  then  P + 0 as  N + ®,  So  by  making  N large 

2 2 

enough,  we  can  transmit  reliably  at  a rate  as  close  as  desired  to 
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NOW  receiver  1 can  learn  ©2  with  arbitrarily  small  probability  of  error. 
Conditioned  on  the  event  that  receiver  1 correctly  guesses  02,  his  probability 
of  error  is 


* 1 

Pe  i = 2 Q < ) 

2Vl 


as  can  be  seen  from  ( 39) . 


Using  the  union  bound,  we  can  upperbound  receiver  l's  overall  error 
probability  by 


P , < P , + P „ 

e,l  — e,l  e,2  ' 

A similar  argument  to  that  used  above  shows  that  we  can  transmit  reliably 
to  receiver  1 at  a limiting  rate 


★ 2 

R^  = W Jin  (1+g^)  nats/second  (4 

* * 

We  now  proceed  to  relate  and  R^  to  the  average  power  constraint  P. 
We  recall  that  at  time  k+1  the  transmitter  sends 


Xk+1  " glalnk  + g2aX'  k “ 1,2,3 N_1* 


The  variance  of  X,  , , is 
k+1 


2 2 2 2,  2 

X = q o + a b 
k+1  gl  1 g2  k 


Assuming  a uniform  prior  distribution  for  0^  and  0^ , 


2 2 1 
X-1=X0  =12- 
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Thus  the  average  power  is 


l 1 i N^1  2 2 2 2 I. 


av  T ) 6 


t 


k=0 


’ 2 k 


i 


i&[?+  " <»H  + *Jb2)] 


(50) 


(51) 


Asymptotically , 


P < 2W 
av  — 


j^g^  + 92(aiai  + a25 


(52) 


We  need  P < P.  This  condition  is  satisfied  if  (substituting  2 an 
av  — 

N_  , 2 

— for  0,  and  a.  in  (52)) 

2 12 


9lNl  + 92(aiNl  + V 


(53) 


Now 


let  g2  = -2E-  where  ae[0,l].  Then  (53)  implies 

^ 31  MM 


J1  N W 


aP 

w 


+ 


[ — + N + N 
1 W 1 2 


(54) 


i.  e. 


ctP 

aP  + (n1+n2)w  ' 


a = 1 - a 


(55) 


Substitution  of  gj  and  g\  back  into  (46)  and  (43)  shows  that  all  rate 
pairs  (R1,  R2>  such  that 

(50) 


W In 


i1  * V ) 


*2  i 


W Jin  1 1 + 


(* 


op 


ap  + 


(n1+n2)w 


are  achievable. 


2.2  Independent  Broadcast  Channel 


The  scheme  described  above  can  also  be  applied  to  a broadcast  channel 
where  the  receiver’s  noises  are  independent,  as  depicted  in  Figure  2.  Note 
that  we  assume  that  one  receiver  has  access  to  the  other's 
feedback  signal.  In  contrast  to  model  1,  the  additional  information  avail- 
able to  receiver  1,  in  the  form  of  receiver  2’s  feedback,  is  usable  in 
improving  his  estimate  of  the  transmitted  number. 

The  analysis  of  this  situation  is  reasonably  similar  to  that  presented 
in  Section  2.1,  and  is  given  in  the  appendix.  It  is  shown  in  the  appen- 
dix that  equations  (14) , (15)  and  (18)  aooly  as  before,  but  that 


(57) 


where 


e 


2k 


2 2 
b,  < b 

k — 


2 2 2 


2 2 
ai  G2 
2 2 
ai  + a2 


(58) 


(59) 


2 ? 

(Note  that  in  model  one,  the  total  noise  to  receiver  2 is  ; here 

2 

it  is  a2  . Indeed  the  assumption  that  the  link  from  transmitter  to  receiver 
2 is  noisier  than  that  from  the  transmitter  to  receiver  1,  while  intrinsic 
to  model  one,  is  not  made  for  model  2.) 

Using  (18),  (57),  (58)  and  arguments  simila  r to  those  used  in  Section 
2 1 we  obtain  that  all  points  within  the  region  described  by 


P <w  in  (l  * f 0-  * M) 

1 2 

*2  i w m (l  * SFT %-)  <e°> 

2 2 

ae  [0,1]  , Nx  = a^,  N2  = <^2  • 
are  obtainable. 

This  is  the  capacity  region  of  the  model.  Although  not  the  usual  de- 
graded AW®  broadcast  channel,  the  communication  problem  defined  by  Figure  2 
is  a degraded  broadcast  channel,  since  at  each  time  receiver  1 has  access 
to  channel  outputs  y^  and  y 2>  while  receiver  2's  channel  output,  y^,  is 
equivalent  to  having  passed  y and  y 2 through  a two  input-two  output  channel, 
by  which  one  input  (y.,)  is  passed  unchanged  and  the  other  (y^)  obliterated. 

Since  the  channel  is  degraded,  the  results  of  [16],  in  which  it  v/as  shown 
that  feedback  does  not  increase  the  capacity  region  for  a degraded  channel, 
apply.  Thus  the  rate  region  for  Figure  2 is  unaffected  if  the  feedback  links 

to  the  transmitter  are  removed.  Since  y . and  y . are  obtained  by  adding 

1 , i 2 , i 

independent  Gaussian  noises  to  x^,  then  it  is  simply  shown  that 


p(Xilyl,iy2,i)  = p(XJ2i) 


where 


g22yl,i*Jl2y2,i 

o2+  c2 

1 2 


for  any  a priori  distribution  on  x^.  Therefore  the  joint  distribution  of 

the  useful  information  to  receiver  one  and  receiver  two  is  equivalent  to  that 
of  a degraded  AWGN  broadcast  channel  for  which  receiver  l's  noise  has  variance 

— r 2 and  receiver  2's  has  variance  Z . The  capacity  reoion  for  this 

ai  + a2 


situation  is  given  by  (60) . Details  of  the  proof  are  given  in  [17] . 
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3.  The  AWGN  Multiple  - Access  Channel 

In  this  section,  we  first  recall  the  capacity  region  of  the  AWGN  multiple- 
access  channel  with  no  feedback.  We  then  examine  the  same  channel  when  feedback 
is  allowed  and  analyze  the  performance  of  a proposed  deterministic  feedback 
coding  scheme. 

The  AWGN  multiple-access  channel  is  the  most  commonly  studied  continuous 

alphabet  channel.  The  output  signal  Y is  the  sum  X^  + x2  + z where  x^  and  x2 

are  the  input  signals  and  Z is  a zero-mean  Gaussian  (noise)  random  variable 

2 2 

independent  of  and  x^,  with  variance  EZ  -a  . There  are  average  power 
constraints  P^  and  on  the  inputs.  The  capacity  region  for  the  AWGN  multiple- 
access  channel  with  no  feedback  allowed  has  been  determined  by  Cover  [12]  and 
Wyner  [13]  to  be  the  set  of  all  rate  pairs  R = (R  , R ) satisfying 
R^  <_  1/2  log2  (1  + — ) bits/transmission 

cr 

P2 

R <_  1/2  log  (1  + — ) (63) 

~ CJ 

Pl+P2 

R!  + R2  i 1/2  log2  U + — 2 } ‘ 

a 

It  has  been  shown  by  Gaarder  and  Wolf  [14]  and  Cover  and  Leung  [15J  that 

in  general  feedback  will  enlarge  the  capacity  region  of  a multiple-access 

i 

channel.  The  model  of  the  AWGN  multiple-access  channel  with  feedback  is  shown 


in  Figure  3 . 
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As  shown,  0.  is  the  message  to  be  sent  by  transmitter  i.X  and  X 

i i * n z ,n 

are  the  outputs  of  transmitters  1 and  2 at  time  n.  The  corresponding  output 
of  the  channel  is  denoted  by  Y 


X , . . . ,X.  , , Y , . . . , Y 

i f n l Jb  n i 


3.1  The  Coding  Scheme 


n 

) . 


X , i = 1,2,  is  a function  of  (0., 
l , n i 


The  notation  which  will  be  used  in  this  section  is  analogous  to  that 
introduced  for  the  broadcast  channel  in  section  2.  We  assume  that  sender 
i,  i = 1,2  wishes  to  send  one  of  M messages  to  the  receiver.  Again,  for  sender  i, 
we  divide  the  unit  interval  [0,1]  into  disjoint  message  intervals  of  equal 
length.  is  the  mid-point  of  the  message  interval  corresponding  to  the 

message  of  sender  i. 

3.1.1  Ini tialization 

The  initialization  procedure  is  done  at  times  -1  and  0.  At  time  -1, 
the  first  encoder  (or  transmitter)  T^  sends  9^  and  the  second  encoder  T^ 
sends  0.  At  time  0,  T^  sends  0 and  T^  sends  0^.  The  corresponding  channel 
outputs  are 


e 


i 


+ 


and 


(64) 


Y0  = 02  + Z0  (65) 

Thus  at  the  end  of  this  initialization  period,  the  receiver's  error  in 
estimating  0^  is  Hj_=  G ^ and  its  error  in  estimating  0^  is  = 2^. 
We  note  that  and  are  jointly  Gaussian  random  variables  with 
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r^2  * £^2  = J and  = 0 


1^1 


3.1.2  Procedure  at  time  k 

We  now  assume  that  after  time  k-1  the  receiver  has 
of  © and  02#  namely 


l,k 


V \ 


and 


2,k 


02  + V 


At  time  k,  the  first  transmitter  Tj_  sends 

Cp7 

x. 


l»k 


ak  ^ 


and  T sends 
2 


'2,k  - (sgn  pky^ck 


where  a. 


2 k r 2 
\ ' bk  = Ck 


\^k 


k fa-5 


k k 


and  sgn  = 


:+i>  i ° 


’-1»  Pk  < 0 


After  time  k,  the  receiver  has  0^  ®2  k and 


'P,  / 2 

Y,  = / — n.  + (sgn  p.  ) / — 5 + Z 


ak  k 


k'  / fc>k  ’k  k 


To  estimate  0^,  the  receiver  first  forms 


computed  estimates 


(66) 


(67) 


(68) 


(69) 


(70) 


(71) 
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i a 


(p1wpip2ipki)rv,  pi 


,bk  (sgnpk) v zkj 


P1  + P2  + ° + 2"PlP2|pk' 


The  receiver's  new  estimate  0 . , of  0 is  obtained  by  first  calculating 


02,k+l  = ®2,k  - (Sgn  Pk>  lP2  \ (80) 

>» 

and  then  proceeding  in  a way  analogous  to  getting  its  new  estimate  of  G^. 
Once  again,  a laborious  calculation  yields 

[p  (l-p  2)  + a2]  b 

b,  , A £ 2 = — — "r — A 3.  b.  (81) 

<+  Pl+P2+°  +2/PlP2'Pk' 

and  r fti  inr  ^ 

r _ (P2VPlP2iTk^LV  1P2\J\  (Sgn  pk)nkMS9n  V hi 
S,C+1  * Pi+P2+°2+2>/PiP2,|pki 


Finally,  it  can  be  shown  that 


2 2 
0 pk  " v/piP2  (sgn  pk,(1"pk") 

7{a2  » p2(1-p=)|  p2.rl(l-c^| 


3 . 2 Achievable  Rates  for  Reliable  Transmission 

The  results  of  the  previous  section  show  that  at  time  N , the 
estimates  of  0^  and  are 


9l.»  ■ ®1  2 "» 


0 + f 

U2  ’N  , 
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where  0 and  £ are  jointly  Gaussian  random  variables  with  zero  means 
N N 


2 N-l  2 

and  variances  a II  a and  0 IT  3 respectively. 
n=l  n n=l  n 


The  error  probability  P in  decoding  0 is  equal  to  the  probability 

6 / X X 


that  0 lies  outside  the  correct  message  interval  of  length  — , i.e., 
1 , N M]_ 


P >22 
e,l 


(85) 


Similarly,  the  error  probability  in  decoding  ©2  is  given  by 


Pe,2  - 2C 


(86) 


Let  lim  a = a and  lim  3 = 3Q 

n-*»  n 00  n-*°°  n ° 


Then  by  making  N large  enough,  the 


receiver  can  decode  0^  with  arbitrarily  small  error  probability  as  long 


as  the  rate  of  transmission  satisfies 


log2Ml  1 

Ri  4 — 2—  < 1/2  log2  “ 

CO 


bits/transmission 


(87) 


Similarly,  ©2  can  be  reliably  decoded  if 


log  M 

„ . 22  . , „ , 1 bits/transmission 

R A < 1/2  log^  t 

2 — 2 


(88) 


N 


3.3  Numerical  Results 


In  order  to  obtain  numerical  results,  let  us  consider  the  case  when 


P^  = P2  = o • Then  (83)  reduces  to 


(1-Pk  ) sgn 


"k+1 


2 “ P, 


(89) 


It  was  found  by  iteration  using  (89)  that  p^  , 


alternates  in  sign  and  lim  ! p ! = 0.31111. 

k-«°  1 k1 


Ik  — 2 1 3 f • • , 
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Using  this  in  (78)  and  (81)  we  obtain 

*0  = 3.  = 0.5254.  (90) 

(37)  and  (88)  then  show  that  reliable  transmission  from  the  two  transmitters 
to  the  receiver  is  possible  at  rates  R^  and  R^  where 

R1  = R2  = 0.4642  bits /transmission.  (91) 

For  comparison,  we  note  that  for  this  example,  the  Cover-Leung  scheme 
in  [7]  can  achieve 

R1  = R2  = 0.4353  bits /transmission  (92) 

The  total  co-operation  upperbound  gives 

R^  = R^  = 0.5805  bits  /transmission.  (93) 

The  best  equal  rate  pair  that  can  be  achieved  with  no  feedback  link 

is  R,  = R„  = 0.3962  bits. 

1 2 

4 . Discussion 

Deterministic  coding  schemes  for  two  models  of  the  AWGN  broadcast 
channel  with  feedback  were  examined.  The  schemes  allow  reliable  transmission 
at  all  rate  pairs  within  the  capacity  regions  of  the  corresponding  AWGN 
channel  without  feedback.  These  regions  are  identical  to  the  capacity 
regions  of  the  models  examined  [16,  17], 

At  each  iteration  after  the  initialization  period,  the  "corrections" 
sent  by  the  transmitter  to  the  two  receivers  are  suitably  amplified  and 
superimposed  so  that  the  expected  power  of  each  transmission  is  close  to 

p 

but  bounded  by  . Receiver  1 gets  a new  estimate  of  his  message  9^  by 
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combining  his  new  signal,  his  previous  estimate  of  0^  and  his  knowledge 
of  receiver  2's  estimate  of  Receiver  2 updates  his  estimate  of  ©2 

by  combining  his  new  signal  with  his  previous  estimate  of  02 . 

We  might  point  out  that  from  (41) , (42)  and  (45)  it  can  be  deduced 
that  if  < C1(a)  and  R2  < C^f^),  both  Pg  ^ and  Pg  2 decay  "doubly 
exponentially"  to  zero  with  N. 

The  two  models  treated  here  assume  a unidirectional  link  between 
one  receiver  and  the  other.  In  [17] , this  assumption  is  discarded  and 
a scheme  is  given  which  shows  that  feedback  can  enlarge  the  no-feedback 
capacity  region  if  the  broadcast  channel  is  not  degraded. 

A deterministic  scheme  for  the  multiple-access  channel  with  feedback 
was  also  analyzed.  It  is  shown  that  this  scheme  achieves  points  that 
dominate  the  best  achievable  points  known  to  date.  Error  rates  for 
this  model  also  decay  to  zero  "doubly  exponentially". 

A complete  solution  for  this  multiple-access  channel  has  been  developed 
and  will  appear  in  [17] . In  particular,  the  capacity  region  is  derived.  The 
scheme  presented  here  achieves  a point  on  the  boundary  of  the  capacity  region. 


APPENDIX:  Analysis  for  Independent  Channels  (Model  of  Figure  2) 


The  primary  change  in  the  scheme  for  the  model  is  that  after  the  i^ 
transmission,  receiver  1 can  improve  his  estimate  of  x.  by  combining  his 
channel  output  with  receiver  2's  channel  output.  That  is  receiver  1 has 
obtained 


'l,k  = *k  + *l.k 


y2,k  * \ + Z2 ,k 

He  then  forms  his  best  estimate  of 

, 2 2 2 ■> 

Y,  . = (a  y + a y )/a  + a - 

X / & X X t X X / .%  x X 

(This  applies  also  to  the  initialization  step.) 
Therefore  after  initialization 


P = 9 - 

1,0  1 


Zl  *1,-1  1 Z2.-I 

'I  * 4 


C2,0  S2  " Z2,0 

-2  2 

, 2 . °1  3 2 A _ 2 

and  E [rj  ] = — = a 

:t502]  - 


= 0 + n 
l o 


0 + E 
2 ^0 


sin^l  3 0 (a. 8) 

After  time  k,  we  assume  once  again  that  equations  (14)  (15)  and  (18) 

hold,  but  that 


n,  2k 

k a, 


k ,2  2 2 2 2 

— ' “k  - ° = ?1  Je  * ~2 


(A. 1C) 


-2 


F 


l,k 


If  we  adapt  the  arguments  of  section  2.1.1  allowing  receiver  1 to  use 
to  upgrade  his  estimate  of  0 , and  remembering  that  receiver  2's  noise 


is  independent  of  receiver  l's,  we  obtain  the  following  recursive  expressions 
1 


for  nk+]_  and 


\+l  2 

ai 


gl  J2  2 * 4l,k+l  + ai  Z2 ,k+l 


k+2 


2 2 
ai  + °2 


’k+1 


k_ 

2 

'2 


gig2ai  \ 


k+2 


a. 


k+2  “2 ,k+l 


(A. 11) 


(A. 12) 


~2  2 

Assuming  that  (A. 9)  and  (A. 10)  hold  as  well  as  (18) , we  obtain  that 


2 = 


0"  2k+4 

k+1 


2k+4  e 


2k+2 


- 2 
’k+1 


r + 
’k 


2 2 2k  2 2 2 

+ gi  g2  ai  \ g2  a2 

4 2k+4  + 2k+4 

Ct  Ct  Ct 

2 2 2 


k 


a„ 


2k+4 


2 2 2 2 2 
q q O a O 

+ 1 2 e + 2 2 


a„ 


2k+4 


2k+4 


a. 


.2  2 , 2 2 2 , 
b + g.  (a  + a a ) 
2 2 1 e 


a„ 


2k+4 


(A. 13) 


2k+2 


(A. 14) 


Also  : 


\+l^k+l 


k 2 

Wl  \ 


gig2 


“l  “2 


k+2 


k+2  k+2  2 

ai  a2  J1  + °2 


2 a2 


a a J 
glg2  e 


k+2  k+2 

«1  a2 


g.g.a 

1 2 e 

k+2  k+2 

ct  o t 

1 2 


(A. 15) 
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Note  also  that  the  same  recursions  apply  to  and  d^_  that  did  in  the 
degraded  case. 


Since  equation  (A. 9) , (A. 10) , and  (18)  apply  to  r|  and  they  apply 


to  and  for  all  k,  by  induction  . 
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